Reliability of Layered Neural Oscillator Networks 



OO 

o 
o 



(N 



U 

d 

x> : 



> 

(N 

in 
cn 

in 
o 

OO 

o 



X 



Kevin K. Lin 
Department of Mathematics, University of Arizon^ 

Eric Shea-Brown 
Department of Applied Mathematics, University of Washingto$\ 

Lai-Sang Young 
Courant Institute of Mathematical Sciences, New York University 
(Dated: May 22, 2008) 

We study the reliability of large networks of coupled neural oscillators in response to fluctuat- 
ing stimuli. Reliability means that a stimulus elicits essentially identical responses upon repeated 
presentations. We view the problem on two scales: neuronal reliability, which concerns the re- 
peatability of spike times of individual neurons embedded within a network, and pooled-response 
reliability, which addresses the repeatability of the total synaptic output from the network. We find 
that individual embedded neurons can be reliable or unreliable depending on network conditions, 
whereas pooled responses of sufficiently large networks are mostly reliable. We study also the effects 
of noise, and find that some types affect reliability more seriously than others. 



PACS numbers: 87.19.1j, 05.45.Xt, 05.45.-a 

The replicability of a system's response to external 
stimuli has practical implications. For example, if a sen- 
sory stimulus is presented to a neural network multiple 
times, how similar are the spike trains that it evokes? 
The answer to this question, i.e., the reliability of the 
system, impacts the precision of neural codes based on 
temporal patterns of spikes [l| . Reliability issues are im- 
portant in the biological sciences, in optics, and in elec- 
tronic circuit theory. 

This Letter discusses the reliability of networks in the 
context of neuroscience, where a number of studies have 
been conducted via analysis, simulations, and laboratory 
experiments. To summarize, there is strong evidence that 
single neurons are typically reliable [1, [J 0] • However, 
for neurons embedded within large networks, a range of 
behavior from reliable to unreliable is seen [H, 0, 0, S] • 

From a theoretical standpoint, under what conditions 
is a network reliable? We answer this question for a class 
of neural oscillator networks that are idealized models of 
commonly occurring situations in neuroscience, namely 
networks with layers [9(. Specifically, we consider net- 
works with either one or two layers, with sparse intra- 
layer and inter-layer connections. Reliability of individ- 
ual neurons and their pooled responses are studied. To 
make transparent the mechanisms involved, we first ne- 
glect the effects of noise, introducing it only later on. 

The setup above can be seen as a driven dynamical 
system. Because we are interested in large networks, the 
accompanying dynamical systems have many degrees of 
freedom, making a statistical approach desirable. For 
this reason, and to describe rapidly fluctuating stimuli 
and noise, we have chosen to cast the problem in the 
framework of random dynamical systems theory. Our 
findings are based on a combination of qualitative the- 
ory and numerical simulations. 

I. Model details. Individual neurons are modeled as 



phase oscillators or "Theta neurons" ; this is a common 
model for neurons in intrinsically active, "mean-driven" 
firing regimes 0, [Tl| . We study pulse-coupled networks 
described by equations of the form 
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% = 1, • • • N, where N 3> 1 (see e.g. [10(). The variables 
9i are the states of the neurons, i.e. they are angles pa- 
rameterized by [0, 1] with periodic boundary conditions. 
The uii are intrinsic frequencies, and the aji are synaptic 
coupling strengths, mediated by a smooth function g > 
with Jj g{6) d9 = 1 and g{9) > for 6 e [-i, i] 0. 
That is to say, neuron j "spikes" when 6j = 0, exciting 
or inhibiting neuron i depending on whether aji is > 
or < (aji = means neuron i does not receive direct 
input from neuron j). The phase response curve is given 
by z(9) = ^[1-008(2^0)], as for "Type I" neurons. The 
stimulus is represented by I(t), which we take to be a 
"frozen" or quenched white noise, i.e., I(t) dt = dWt 
where Wt is a realization of standard Brownian motion; 
we have found that the addition of low-frequency compo- 
nents to I(t) does not substantially change our results. 

We now explain how the parameters LUi,aji and in 
Eq. (Q]) are chosen. In a reliability study of a fixed net- 
work, these parameters remain frozen, as does I(t), and 
each trial corresponds to a randomly-chosen initial con- 
dition in the system defined by (fTj). 

To incorporate some of the heterogeneity that occurs 
biologically, we assume a 20% variability in uji and in the 
aji. Specifically, the u>i are drawn randomly and inde- 
pendently from the uniform distribution on the interval 
[0.9,1.1]. (The discussed below.) 

We study two types of layered network structures: 
Single-layer networks. We set e, = e for all i, so that 
all neurons receive the same input I(t) at the same am- 
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FIG. 1: Raster plots of single oscillators drawn randomly from 
two different networks. Spike times are recorded for 20 trials. 
We set e = 2.5 and N = 100 in both numerical simulations. 
Top: Single-layer model, A = 1; A max = —0.57. Bottom: 
Two-layer, A s = 2.8, A & = 2.5, Ai = A 2 = 1; A max = 0.53. 

plitude e. We assume a 20% connectivity with mean 
synaptic strength a, i.e., each neuron receives input from 
k = 0.2 N other neurons (chosen randomly in simula- 
tions), and the nonzero ciji are drawn independently and 
uniformly from [0.9a, 1.1a]. The two main network pa- 
rameters are thus e and a. 

Two-layer networks. We divide the neurons into two 
groups of size y each, referred to as Layer 1 and Layer 
2. We set = e for all neurons i in Layer 1, and 
€i = in Layer 2. Each neuron receives connections 
from k = 0.2 N other neurons, with # from its own 
layer and t| from the other layer. Intra-layer connections 
within Layer 1 (resp. Layer 2) have mean strength ai 
(resp. 02). For inter-layer connections, Layer 1 — > 2 
connections have mean strength as, while Layer 2^1 
connections have mean strength afb . (Here, "ff" and "fb" 
refer to "feedforward" and "feedback".) Actual, hetero- 
geneous coupling constants are randomly chosen to lie 
within 1 ± 0.1 of their mean values as before. The main 
system parameters here are e, ai, a2, ag, and afb- 

II. Neuronal reliability. This refers to the repeatabil- 
ity of spike times from trial to trial for individual neurons 
within a network when the same stimulus I(t) is pre- 
sented over multiple trials. Fig. [1] shows raster plots for 
two arbitrarily chosen neurons drawn from two different 
networks. The top panel shows repeatable spike times; 
this is our definition of neuronal reliability. The bottom 
shows unreliability: spike times persistently differ from 
trial to trial. The latter cannot happen for single Theta 
neurons in isolation, as they are always reliable [H, 0] ■ 

Neuronal reliability is closely related to stability prop- 
erties of the dynamical system defined by Eq. ^ [3, |4|, 
Recall that Lyapunov exponents measure the 
rates of divergence of nearby orbits. These numbers make 
sense for deterministic as well as random dynamical sys- 
tems. For the latter, under mild assumptions they are 
independent of initial condition or realization of Brown- 
ian path (see [HI]). Let A max denote the largest Lyapunov 
exponent of (p]). The following are known mathematical 
facts If A max < 0, then regardless of the state of 

the network at the onset of the stimulus, all trajectories 
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FIG. 2: Lyapunov exponents A max . Left: Single-layer, TV = 
100, e = 1.5 (top curve), 2.5 (bottom curve). Right: Two- 
layer, N = 100, A s = 2.8, Ai = \A 2 \ = 1 (with sign(A 2 ) = 
sign(Afb)), e = 2.5. Three realizations of network graphs are 
used in each case with their plots superimposed. 





FIG. 3: Phase distributions of neurons at the instant they 
receive an incoming spike. Left: Single-layer, A = 1.8; all 
spikes. Right: Two-layer, As = 2.8, Afb = 0.8, Ai = Ai = 1; 
for inter-layer spikes only - right peak for phases of Layer 1 
neurons, left peak for Layer 2. 

coalesce into a small region of phase space; this scenario, 
referred to as a random sink, is equated with entrainment 
to the stimulus and neuronal reliability. Conversely, if 
Amax > 0, the trajectories organize themselves around 
a complicated object called a random strange attractor. 
This means that at a given point in time, the network 
may be in many different states depending on its initial 
condition, i.e., it is unreliable. 

Our challenge here is to understand network reliabil- 
ity in terms of the system parameters introduced above. 
Measuring reliability using a single quantity, A max , has 
the advantage that large parts of the landscape can be 
seen at a glance, as in Fig. [2] [15]. 

Single-layer networks. We find that it is fruitful to view 
Amax as a function of the quantity A = na, which has the 
following interpretation: Focus on an arbitrary neuron, 
say neuron i. In the absence of any knowledge of the dy- 
namics (e.g. firing rates), we expect each of its n presy- 
naptic neighbors to spike once per unit time (u w 1), 
with average strength a, and for z(8i) to be at its mean 
value (z) = i.e., we expect neuron i to be pushed 
(forwards if A > and backwards if A < 0) by ^ of 
a cycle per unit time. If the dynamics are to approach 
a meaningful limit as N — > 00, it is necessary to stabi- 
lize the total synaptic input received by a typical neuron. 
Thus A — Ka is a natural scaling parameter. 

Fig. [U (left) shows the basic relationship between 
Amax, A, and e (stimulus amplitude). Plots for 1.5 < 
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FIG. 4: The bulk synaptic output function S(t); one trial 
each for the two sets of parameters in Fig. [1] 

e < 2.5 interpolate between the two curves in a straight- 
forward way. When A = 0, i.e., when the oscillators 
are uncoupled, we have A max < as expected. When 
A ^ 0, A max can be positive or negative. Notice that (i) 
it increases with \A\ for fixed e (the sign of A matters 
little), and (ii) it decreases with e for fixed A. Item (ii) is 
due to the entraining effects of the stimulus; (i) suggests 
that the couplings here are intrinsically destabilizing. We 
find the value of A max to depend strongly on A, but only 
weakly on the underlying balance of N, k, and a for large 
N. Moreover, A max varies little among specific choices of 
connection graph consistent with a given k. 

At first sight, the single-layer network may appear un- 
expectedly reliable: At A = 2, each neuron is expected 
to be perturbed by | of a cycle per unit time, yet Fig. [2] 
(left) shows A max can still be negative. This is due to 
the tendency of the network to synchronize, i.e., to spike 
at roughly the same times (see Fig. [31 left). Because 
z(0) — z'(6) = when 6 = 0, near-synchronization 
means that z{9) is typically quite small when a spike 
arrives, so that the effective total coupling strengths are 
considerably smaller than the a priori strength A. Per- 
fect synchrony is not possible here due to heterogeneity 
in the u>i and dji . For a given network topology, greater 
homogeneity in oji and ciji will lead to greater synchrony 
and smaller effective coupling [HI ]. 

Two-layer networks. We again express A max in terms of 
A\, A 2 , Ag, and A&, defined to be # = 0.1 N times a\, 
a,2, as, and aft,, respectively. The interpretations are as 
before, e.g., As is the a priori total kick received per unit 
time by each neuron in Layer 2 from neurons in Layer 1. 

Fig. [2] (right) shows A max as a function of A^, with 
As = 2.8, Ai = Ai = ±1 (we give A\ and A 2 the same 
signs as Ag and An,, respectively, as each neuron is either 
excitatory or inhibitory), and e = 2.5. At Ar, = 0, the 
system is definitively reliable. As \Aft,\ increases, how- 
ever, we find that the network loses its reliability almost 
immediately, even before \Ar,\ w Jq^s- 

This rather surprising fact is also partially explained by 
the phase distributions of Layer 1 and Layer 2 neurons at 
the instants when they receive inputs from the other layer 
(see Fig. 02 right). The distributions are more spread 
out than in the single-layer case; moreover, their peaks 
are centered away from 9 = 0. This can be predicted 
from reduced two- neuron models 11611 . Thus at the same 




FIG. 5: Mean across-trial variances V. Left: V/N 2 as func- 
tion of N for As = 2.8, Afb = 2.5. Right: V as function of 
Aft,. The setup is identical to that in Fig. [2] (right); N = 100. 

numerical values, As and Ar, in the two-layer model are 
significantly more destabilizing than A in the single-layer 
model. See also [l7|. 

We expect the ideas above, i.e., the tendency to syn- 
chronize within each layer, and the dominant effects of 
inter-layer interactions, to extend to multi-layer systems. 
III. Reliability of pooled responses. Bulk measure- 
ments have arguably greater impacts than the behavior 
of individual neurons. A function representin g th e total 
synaptic output of a system is defined by (cf. |l8l . fljl ]) 



S(t) = J2f(t-T i ); f(t) 



r e ' 



where Tj are spike times of any neuron in the network, 
the summation is over all Tj < t, f is a postsynaptic cur- 
rent, and r w jg- Pooled-response reliability describes 
how repeatable S(t) is in response to 1(f). Clearly, neu- 
ronal reliability implies pooled-response reliability. On 
the other hand, one would expect individual neurons to 
be more volatile than the network as a whole. 

Two time courses for S(t) are shown in Fig. [5] The 
first is for a reliable single-layer system; tall, well-defined 
spikes are generated when the system is in partial syn- 
chrony. The second is for an unreliable, 2-layer model. 
Here the floor of S(t) is strictly positive, i.e., some neu- 
rons in the system are spiking at nearly all times. 

For each t, we measure the repeatability of S(t) by its 
time-dependent, across-trial variance V(t); this informa- 
tion can be distilled further to give a single number V 
by time averaging V(f). Our main finding is that V/N 2 
decreases as N gets larger; see Fig. [5] (left). Though be- 
yond the reach of ergodic theorems, it is apparent that 
due to the effects of averaging, total synaptic outputs of 
sufficiently large networks tend to be reliable, even as 
individual neurons behave unreliably. 

Next, we fix N. As parameters are varied, we find 
strong correlation between A max and V; compare Figs. [5] 
(right) and[5] (right). This confirms that the two different 
ways of measuring unreliability we have proposed are in 
good qualitative agreement. 

IV. Effects of noise. By "noise" , we refer to trial-to- 
trial fluctuations not modeled by Eq. (fTJ). For a clear 
conceptual understanding of its impact on reliability, we 
find it useful to distinguish between (i) noise that af- 
fects each neuron differently (e.g. synaptic or membrane 
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noise), and (ii) noise that affects the entire population 
in essentially the same way (e.g., noise associated with 
the stimulus I(t)) [H, As an idealization, we add to 
Eq. fTJ) two noise terms: 

Bi =Ui + z(Bi)- l^Taji g(6j) + edit) + a e rn(t) + a g ((t) 

Here and T)i(t) are white noise realizations which vary 
independently from trial to trial; additionally, the r)i(t) 
are independent for each i. We refer to rji(t) and £(t) as 
"local" and "global" noise; their respective amplitudes 
are denoted by o~e and a g . 

Our simulations show that neuronal reliability persists 
under some level of local and global noise (although a 
gradual degradation of spike time precision from trial to 
trial is unavoidable). As expected, pooled responses can 
tolerate higher-amplitude noise terms. 

Since local noise is more varied, one might expect it 
to lead to greater unreliability. This, however, is not 
true. We find that local noise has only a limited effect 
on pooled-response reliability for large networks, likely 
due to averaging effects. In contrast, the effects of global 
noise can be much more severe. The table below shows 
V/N 2 in two representative cases: 







Noise amp. (o~i,o~ g ) 






(0, 0) (0.3, 0) (0, 0.3) 


Case 1: 


Reliable 


0.0 0.016 0.37 


Case 2: 


Unreliable 


0.090 0.076 0.36 



Cases 1 and 2 are respectively the reliable and unreliable 
cases in Fig. [TJ The loss of reliability (in a neuronally 
reliable system) due to global noise can be understood 
as follows: Recall from Sec. II that reliability means all 
trajectories independent of initial condition coalesce into 
a "random sink" for each t. Within each trial, since £(t) 
is a term of the same type as I(t), its presence strength- 
ens the effects of the stimulus, leading to more robust 
entrainment (see Fig. [2J left). Recall, however, that ((t) 
varies from trial to trial, so the trajectories entrain to 
a different stimulus, and therefore coalesce to a differ- 
ent state on each trial. When a g is large enough, this 
provides a mechanism for destroying reliability. 

Conclusion: We have carried out a systematic study 
of stimulus-response reliability for heterogeneous, layered 
networks of neural oscillators. Our findings - all of which 
are new in the present context and are consistent with 
results of earlier studies of different models - are of a 
very basic nature and thus are likely to shed light on 
situations beyond those considered here: 
(1) On the neuronal level, single-layer networks are fairly 
reliable due to a tendency to synchronize, while recurrent 
connections can be strongly destabilizing in two-layer sys- 
tems. In general, individual neurons can behave reliably 
or unreliably as a result of the competition between en- 
trainment to the stimulus or upstream layer and the per- 
turbative effects of other synaptic events. 



(2) Pooled responses of large enough networks are mostly 
reliable even when individual neurons within it are not. 
In a fixed-size network, they have similar reliability prop- 
erties as individual neurons but with lower volatility. 

(3) Global noise, i.e., noise that affects the entire popu- 
lation in roughly the same way, can seriously jeopardize 
even pooled-response reliability, while local noise has only 
limited effect. 
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